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Abstract 

We analyse the large-scale structure of the journal citation network built from 
information contained in the Thomson-Reuters Journal Citation Reports. To 
this end, we take advantage of the network science paraphernalia and explore 
network properties like density, percolation robustness, average and largest node 
distances, reciprocity, incoming and outgoing degree distributions, as well as as- 
sortative mixing by node degrees. We discover that the journal citation network 
is a dense, robust, small, and reciprocal world. Furthermore, in and out node 
degree distributions display long-tails, with few vital journals and many trivial 
ones, and they are strongly positively correlated. 

Key words: Network science, bibliometrics, journal citation networks, journal 
citation indicators. 



1. Introduction 

The present study is an interdisciplinary research integrating the fields of 
network science and bibliometrics. The field of network science - the holistic 
analysis of complex systems through the study of the structure of networks that 
wire their components - exploded in the last decade, boosted by the availability 
of large databases on the topology of various real networks, mainly the Web and 
biological networks. The network science approach has been successfully applied 
to analyse disparate types of n etworks, including technologi c al, information 
socia l , and biologica l networks ( Brandes and Erlebach . l2005l iNewman et al 



2006t lNewmMl , l2010t ). Network analysis can be performed at different levels of 



aggregation: 

• Node-level analysis. At this level, the goal is to measure the importance 
or centrality of a node within the network. Centrality here is not an 
intrinsic and permanent feature of the node but, instead, it is an extrinsic 
and fleeting property that depends on the interactions of the node with 
the other nodes in the network. Typical node centrality measures include 
degree, eigenvector, closeness and betweenness centrality. 
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• Group-level analysis. This investigation involves methods for defining and 
finding cohesive groups (clusters) of nodes in the network. The definition 
of cluster depends only on the topology of the network. Clusters are 
tightly knit sets of nodes with many edges inside the cluster and only a 
few edges between clusters. Two typical methods at this level of analysis 
are graph partitioning (where the number of clusters is fixed in advance) 
and community detection (in which the number of clusters is unspecified). 

• Network- lev el analysis. The focus of this analysis is on properties of net- 
works as a whole such as connectivity, mean and largest distances among 
nodes, distribution of node degrees, frequency of topological motifs, and 
assortative/disassortative mixing. It also includes the investigation on the- 
oretical models explaining the generation of networks with certain features 
(e.g., random, small- world, and scale- free models). 

Bibliometrics is an older field; it is a branch of information and library 
science that q uantitatively investigates the proce ss of publication of research 
achievements ( Garfield . 1955t de Solla Price . 1965 ). Networks abound in biblio- 
metrics; two important examples are citation networks of articles, journals or 
disciplines and collaboration networks of scholars. Other bibliometric networks 
are co-citation and co-reference networks of articles, journals or disciplines. 
Collab oration networks have been largely studied using the network science 
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approach ( Newmanl. [20041: iBarabasi et al. . _ _ . . _ _ _ _ _ . 

Radicchi et al. , 2004 ; Francescheti 2011 ) . Journal citation networks have been 
investigated mainly at node- and group-levels. The investigation at the node- 
level concerns the proposal of eigenvector-based centrality meas ures for journals 
(|Pinski and Narinl . Il976l : iBollen et all . l2006t IWest et all l2010[ ). the clustering 



of journal bibliometric indicators, inclu ding centrality measures, on the basis o f 
the statistical correlation among them (iLevdesdorflJ . 120091: iBollen et al.l . 120091) ■ 
as well as t he use of betweenness central ity as an interdisciplinary indicator 
for journals ( Levdesdorflt and Rafolsl . feoill) . The group-level analysis of journal 
citation networks focuses on the detection, using different methods, of com- 
munities o£journals , which correspond to fields of knowledge in the map of 
science ( Levdesdorflt 2004 Rosvall and Bergstromi 120081 : iKlanans and Bovack . 
2009t iLevdesdorflF et al.l . l2010l) . 

The investigation of journal citation networks at the network-level has been 
mainly focus ed on the study of the distribution of citations among papers 
and j ournals ( Seglen . [l992l : iRednei . Il998t IStringer et all , [ioost I Radicchi et al.l . 
20081) . The aim of the present investigation is to complement this investigation 



with additional large-scale structure properties of journal citation networks. 
More specifically, we focus on the following network properties: density of cita- 
tion links, robustness with respect to the removal of nodes according to differ- 
ent percolation strategies, average and largest path lengths, topological motifs 
of reciprocity, incoming and outgoing degree distributions and their statistical 
correlations, as well as assortative mixing with respect to incoming and outgoing 
node degrees. 
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2. The large-scale structure of journal citation networks 



We considered all science and social science journals indexed in Thomson- 
Reuters Journal Citation Reports. We built a journal citation network in which 
the nodes are the selected journals and there is a directed edge from node A 
to node B if journal A published in 2008 a paper that cites a paper printed in 
journal B in the temporal window between 2003 and 2007. We only took into 
account the document types article and review. We considered the sub-network 
corresponding to the largest strongly connected component of the original net- 
work, which covers the large majority of the original networkj^ The resulting 
network is a directed unweighted graph with 6708 nodes and 1,315,238 edges 
between journals with the property that there exists a directed path between 
any pair of no des. We loaded the network in th e R environment for statisti- 
cal computing (jR Development Core Team , l2008l) and analysed the structure of 
the network using the R package igraph developed by Gabor Csardi and Tamas 
Nepusz. 

The first network property that we analyse is density. Graph density is the 
relative fraction of edges in the graph, that is the ratio of the actual number of 
edges and the maximum number of possible edges in the graph. The density of 
the journal citation graph is 3%, meaning that the graph has 3 edges every 100 
possible links between nodes. The density is much higher if we consider only top 
journals with large total degree, where the total degree of a journal is the sum 
of the number of incoming edges (citing journals) and the number of outgoing 
edges (cited journals) of the journal in the network. We sorted the journals 
in decreasing order of total degree and we computed the density of the graph 
containing only an increasing share of top journals; the corresponding plot is 
depicted in Figure[T] For instance, when only the top-30 journals are considered, 
the citation network, which is shown in Figure [21 is almost completed, with a 
remarkably high density of 93% (only 64 edges out of the 870 possible edges are 
missing). Notably, the density is relatively high (32%) also for the network of 
top-1000 journals. 

The journal citation graph is, by construction, strongly connected. This 
means that there exists a directed path of citations between any pair of journals 
in the graph: a researcher can start reading any journal in any subject, e.g., 
tribology, and by following links of citations, they can reach any other journal in 
any other subject, e.g., mycology. Related to connectedness of a network is the 
concept of robustness. Network robustness is typically investigated with a dy- 
namic process called percolation. The percolation process progressively removes 
nodes, as long as the edges connected to these nodes, from the network, and 
studies how the connectivity of the network changes. In particular, one wants to 
find the fraction of nodes to remove from the network in order to disintegrate its 



^ It is typical in network science to focus the analysis on the largest component w hen this is 
a giant one, that is, when it includes the large majority of the nodes of the network jNewmanl . 

Hoict). 

complete graph, or clique, is a graph with all possible edges. 



3 



d 



200 



400 600 
Number of hubs 



800 



1000 



Figure 1: The density of the network of top journals (journals with high total degree). The 
X axis shows the number of top journals (up to 1000) and the y axis gives the density of the 
network containing only these journals. 



giant strongly connected component into small components. If such a fraction 
is relatively large, then the network is said to be robust to the process of perco- 
lation. To realize the percolation process, we progressively removed nodes from 
the collaboration network and, after each removal, we computed the relative 
size of the largest strongly connected component of the resulting sub-network. 
We tested the following node removal strategies (Newman, 2010f) : 



1. 



2. 



3. 



4. 



degree- driven percolation, in which the nodes are removed in decreasing 
order of node total degree (the sum of the in-degree and the out-degree of 
the node); 

eigenvector- driven percolation, in which the nodes are removed in decreas- 
ing order of eigenvector centrality scores. A node has high eigenvector 
score if it is pointed to by nodes which, recursively, have high eigenvector 
scores; 

closeness-driven percolation, in which the nodes are removed in decreasing 
order of closeness centrality scores. A node has high closeness score if the 
mean distance from the node to all other nodes in the network is low; 
betweenness- driven percolation, in which the nodes are removed in decreas- 
ing order of betweenness centrality scores. A node has high betweenness 
score if the node lies on many geodesies (shortest paths) between other 
nodes in the network. 
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Figure 2: The citation network of the top-30 journals. The (almost) complete graph resembles 
some Escher's works. 



Figure |3] shows the outcomes of the described percolation process. A couple 
of observations emerge from the plot. First, the best percolation strategy is 
based on the removal of nodes in order of betweenness centrality. It dominates 
the total degree strategy, which is better than the closeness one. The least ef- 
fective percolation strategy is the one based on eigenvector centrality. Hence, 
when the objective is to dismantle the (strong) connectivity of the network, 
removing 'broker' nodes (nodes with high betweenness) is more effective than 
removing nodes with high total degree. Nodes w ith high betweenness score hav e 
been associated with interdisciplinary journals (jLevdesdorff and Rafold . l201ll) . 
while those with high total degree typically correspond to review journals. It 
follows that interdisciplinary journals are more responsible to keep the citation 
network strongly connected than review publication sources. Second, no per- 
colation strategy is in fact really effective. Using the best percolation strategy 
(betweenness), 82% of the nodes (almost the entirety of the graph) should be 
removed to reduce the largest strongly connected component below 50% of the 
graph. This is a distinct sign of the strong robustness of the journal citation 
network. 

The fact that the journal citation network is strongly connected does not tell 
us anything about the lengths of paths in the network. For instance, compare a 
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Figure 3: Network robustness using the percolation process. The fraction of nodes removed 
from the network is plotted against the relative size of the largest strongly connected com- 
ponent. Four centrality strategies have been tested to remove the nodes in the percolation 
process. 



graph composed of a circle of nodes and a complete graph in which there is an 
edge connecting each pair of nodes. Both graphs are strongly connected, but the 
average distance between nodes in the first graph is of the order of the number 
of nodes, while in the second graph it is just 1. The geodesic distance between 
two nodes in a graph is the number of edges of a shortest path (also known 
as geodesic) connecting the two nodes. We computed the geodesic distance for 
any pair of nodes in the graph. Figure |4] shows the geodesic distance histogram. 
The average geodesic distance is remarkably short: 2.4 edges. This means that 
given a random pair of journals, we can expect that in two or three citation hops 
we get from one journal to the other. The maximum geodesic distance, known 
as the diameter of the network, is just 6 links (there are 20 paths with this 
largest length). We may conclud e that the journal citation network is a small 
world ( Watts and Strogat3 . ll998l ). in the sense that the average node distances 
are remarkably short (logarithmic) with respect to the number of nodes of the 
network. 

It is worth noticing that the average path length on co-reference networks 
have been recently proposed by iRafols and Mever ( 2010[ ) in the context of in- 
dicators of interdisciplinarity. The authors investigate the interdisciplinary re- 
search in terms of two aspects: diversity (the number, balance and degree of 
difference between the bodies of knowledge integrated) and coherence (the ex- 
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Figure 4: Histogram of geodesic distances. For any given geodesic distance from 1 to the 
diameter of the network (6), a bar shows the percentage of geodesies having that distance. 



tent that specific topics, concepts, tools and data used in a research process are 
related). In particular, they propose the mean path length defined on paper 
bibliographic coupling networks as a possible operationalization of the concept 
of network coherence. 

Real complex networks possess basic building blocks or motifs: patterns of 
interconnections occurring in complex netw orks at numbers th at are significantly 
higher than those in randomized networks ( Milo et all . 2002[ ). Such motifs have 
been found in diverse networks from biochemistry, neurobiology, ecology, and 
engineering. It is conjectured that these patterns play the role of functional 
circuit elements of the complex system underlying the network. The simplest 
motif that can be studied on a directed network is the loop of length two. On the 
journal citation network, this corresponds to a pair of journals that reciprocally 
cites themselves. This concept is known as reciprocity in network science and 
it is operationalized by counting the relative freque ncy of edges that belong to 
a loop of length two in the network ( Newman . 20101) . We computed reciprocity 
for the journal citation network and the result is 0.29; this means that 29% of 
the times that a journal A cites another journal B we have that B cites back 
to A. This high percentage can be explained with the well-known phenomenon 
that journals can be partitioned into highly-connected clusters corresponding 
to disciplines and fields of them when journals a re displayed on a citation map 
(see, for instance, Rosvall and Bergstrom ( 20081) 1. 



Finally, we investigate the node degree distributions of the journal citation 
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Figure 5: The node out-degree (number of cited journals) distribution. 



network. Since the citation network is a directed graph, each journal has an 
out-degree ~ the number of distinct journals cited by the journal, or the number 
of edges leaving the journal node -, and an in-degree ~ the number of distinct 
journals citing the journal, or the number of edges arriving to the journal node. 
Figures [S] and [HI respectively, depict the out-degree and the in-degree distribu- 
tions for nodes of the journal citation network. Both distributions have a clear 
long-tail: most of the journals cite and arc cited by a relatively small number of 
other journals, but there is a significative number of hubs ~ journals that cite a 
large amount of other journals -, and authorities, journals that are cited by a 
big number of other journals. The average degree for both distributions is 19611 
The median out-degree is 126, with a maximum out-degree of 2193 (a third 
of the total number of journals) accomplished by journal PNAS. The median 
in-degree is 109, with a maximum in-degree of 3697 (more than half of the total 
number of journals) obtained by journal Science (PNAS is second with 3640). 
The in-degree distribution is more skewed and concentrated (skewness index is 
3.5 and Gini concentration coefficient is 0.55) than the out-degree distribution 
(skewness index is 1.9 and Gini concentration coefficient is 0.49). Neither dis- 
tribution follow a power-law, so the network cannot be regarded as a scale-free 



•^This is the same number since each edge leaving a node is arriving at a node; this is also 
equal to the ratio of the number of edges and the number of nodes of the network. 
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Figure 6: The node in-degree (number of citing journals) distribution. 



network ijBarabasi and Alberd . [19991 ) Fl 

Furthermore, the two distributions (in- and out-degree) are positively cor- 
related (Spearman and Pearson correlation coefficients are 0.90 and 0.87, re- 
spectively): this means that there is a tendency for authority journals to be 
also hub journals and vice versa. This outcome is not crucially influenced by 
the size of the journal (in terms of number of published papers); indeed, the 
correlations of journal in-degree and out-degree with journal size are moderate 
(Spearman and Pearson correlation coefficients are 0.72 and 0.55, respectively). 
We also raised the following questions: do authorities prefer to cite other author- 
ities/hubs? Do hubs prefer to cite other hubs/authorities? In network science, 
assortative/disassortative mixing is the tenden cy of nodes to c onnect to other 
nodes that are like/dislike them in some way (|Newmanl . l2010l ). The concept 
is implemented as a Pearson correlation coefficient over the investigated scalar 
characteristic (in- or out-degrees in our case) for nodes connected by an edge in 
the network. The correlation is positive and statistically significant in all four 
cases: 0.08 for authority/authority mixing, 0.14 for hub/hub mixing, 0.11 for 
authority/hub mixing, and 0.08 for hub/authority mixing. The low magnitude 



*We preliminarily observed a clear curvature of the complementary cumul ative distribu- 
tion f unction plotted on a double logarithmic scale; furthermore we performed IClauset et all 
||2009| '| goodness-of-fit test for the power-law and log-normal models. Both tests excluded a 
(statistically significant) fit of the empirical distributions of degrees to the surveyed theoretical 
models (not even in a tail portion of the distribution for the power-law model). 
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of the correlation coefficients is not surprising: most networks are naturally 
disassortative by degree because they are simple graphs (at most one edge is 
possible between two nodes). Hence, a positive correlation in this case, although 
not large in magnitude, indicates a real assortativity by degree. In particular, 
networks h aving a commun ity structure override this natural bias and become 



assortative ( Newman . 20101) 



3. Conclusion 

We have analysed the journal citation network extracted from Thomson- 
Reuters Journal Citation Reports. Our conclusions are summarized in the fol- 
lowing: 

• the journal citation network has high reciprocity and positive assortativity 
by degree, which is coherent with a community structure, in which there 
are tightly interconnected sets of journals that most likely represent entire 
disciplines or fields of them; 

• the journal citation network is a dense and small world. This means that, 
although the network is divided into closely integrated communities, there 
are quite intense inter-community flows of information (citations), and 
hence information can spread quickly over the whole academic community; 

• the journal citation network is highly robust. These is good news for the 
whole academic community, since it means that there exists no restricted 
circle of influential journals that control the connectivity of the network 
and the diffusion of information on the whole academic community, al- 
though there are journals that are very influential within their local fields; 

• interdisciplinary journals are more crucial than review sources for the 
connectivity of the network and for the diffusion of information over the 
academic community. The identification of interdisciplinary journals is 
a hot, partially open problem; interdisciplinarity is often perceived as a 
mark of good rese arch, more successful in achieving breakthroughs and 
relevant outcomes ( Rafols and Mevei . 2010t ): 



• the degree distribution of the journal citation network shows a long tail 
with many poorly endorsed journals an a significant few highly cited ones; 
the empirical distribution, however, does not match well the power-law 
model. To test the adherence to the po wer-law model we use d the princi- 
pled statistical framework developed by IClauset et al. I (|2009[ ). The same 



method is used by the developers to analyse a large number of real- world 
data sets from a range of different disciplines, each of which has been 
conjectured to follow a power law distribution in previous studies. Only 
two-third of them passed the test, and all of them showed the best adher- 
ence to the model when a (limited) suffix of the distribution is considered. 
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